Event-VPR: End-to-End Weakly Supervised Deep Network Architecture for Visual Place Recognition Using Event-Based Vision Sensor

نویسندگان

چکیده

Traditional visual place recognition (VPR) methods generally use frame-based cameras, which will easily fail due to rapid illumination changes or fast motion. To overcome this, we propose an end-to-end VPR network using event can achieve good performance in challenging environments (e.g., large-scale driving scenes). The key idea of the proposed algorithm is first characterize streams with EST voxel grid representation, then extract features a deep residual network, and, finally, aggregate improved VLAD realize streams. verify effectiveness algorithm, on event-based datasets (MVSEC, DDD17, and Brisbane-Event-VPR) synthetic (Oxford RobotCar CARLA), analyze our method sequences, including cross-weather, cross-season, changing scenes, then, compare state-of-the-art (Ensemble-Event-VPR) prove its advantages. Experimental results show that better than ensemble scheme scenarios. best knowledge, for task, this weakly supervised architecture directly processes stream data.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

End-to-end weakly-supervised semantic alignment

We tackle the task of semantic alignment where the goal is to compute dense semantic correspondence aligning two images depicting objects of the same category. This is a challenging task due to large intra-class variation, changes in viewpoint and background clutter. We present the following three principal contributions. First, we develop a convolutional neural network architecture for semanti...

متن کامل

Supervised Hashing with End-to-End Binary Deep Neural Network

Image hashing is a popular technique applied to large scale content-based visual retrieval due to its compact and efficient binary codes. Our work proposes a new end-to-end deep network architecture for supervised hashing which directly learns binary codes from input images and maintains good properties over binary codes such as similarity preservation, independence, and balancing. Furthermore,...

متن کامل

End-to-end Delay Analysis for Event-driven Wireless Sensor Network Applications

The end-to-end delay is one of the most critical and fundamental issues for wireless sensor networks. Many applications of sensor networks require an end-to-end delay guarantee for time sensitive data. However, the end-to-end delay is difficult to bound for event-driven sensor networks, where nodes generate and propagate data only when an event of interest occurs, thereby producing unpredictabl...

متن کامل

End-to-End Deep Neural Network for Automatic Speech Recognition

We investigate the efficacy of deep neural networks on speech recognition. Specifically, we implement an end-to-end deep learning system that utilizes mel-filter bank features to directly output to spoken phonemes without the need of a traditional Hidden Markov Model for decoding. The system will comprise of two variants of neural networks for phoneme recognition. In particular, we utilize conv...

متن کامل

End-to-End Deep Learning for Driver Distraction Recognition

In this paper, an end-to-end deep learning solution for driver distraction recognition is presented. In the proposed framework, the features from pre-trained convolutional neural networks VGG-19 are extracted. Despite the variation in illumination conditions, camera position, driver’s ethnicity, and genders in our dataset, our best fine-tuned model, VGG-19 has achieved the highest test accuracy...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Instrumentation and Measurement

سال: 2022

ISSN: ['1557-9662', '0018-9456']

DOI: https://doi.org/10.1109/tim.2022.3168892